Pandas Profiling Report

Dataset statistics

Number of variables	15
Number of observations	5705
Missing cells	0
Missing cells (%)	0.0%
Duplicate rows	0
Duplicate rows (%)	0.0%
Total size in memory	668.7 KiB
Average record size in memory	120.0 B

Variable types

Numeric	15

Alerts

`gross_revenue` is highly correlated with `qnt_purchases` and 3 other fields	High correlation
`recency_days` is highly correlated with `qnt_purchases`	High correlation
`qnt_purchases` is highly correlated with `gross_revenue` and 5 other fields	High correlation
`var_products` is highly correlated with `gross_revenue` and 4 other fields	High correlation
`qnt_items` is highly correlated with `gross_revenue` and 4 other fields	High correlation
`freq_purchase` is highly correlated with `qnt_purchases` and 1 other fields	High correlation
`qtd_returned` is highly correlated with `qnt_purchases` and 3 other fields	High correlation
`freq_returns` is highly correlated with `qtd_returned` and 2 other fields	High correlation
`avg_basket_size` is highly correlated with `gross_revenue` and 3 other fields	High correlation
`avg_basket_variety` is highly correlated with `var_products` and 1 other fields	High correlation
`item_rp_ratio` is highly correlated with `qtd_returned` and 2 other fields	High correlation
`net_margin` is highly correlated with `qtd_returned` and 2 other fields	High correlation
`gross_revenue` is highly correlated with `qnt_purchases` and 1 other fields	High correlation
`qnt_purchases` is highly correlated with `gross_revenue` and 2 other fields	High correlation
`var_products` is highly correlated with `qnt_purchases`	High correlation
`qnt_items` is highly correlated with `gross_revenue` and 1 other fields	High correlation
`avg_ticket` is highly correlated with `qtd_returned` and 1 other fields	High correlation
`qtd_returned` is highly correlated with `avg_ticket` and 1 other fields	High correlation
`avg_basket_size` is highly correlated with `avg_ticket` and 1 other fields	High correlation
`item_rp_ratio` is highly correlated with `net_margin`	High correlation
`net_margin` is highly correlated with `item_rp_ratio`	High correlation
`gross_revenue` is highly correlated with `qnt_purchases` and 3 other fields	High correlation
`qnt_purchases` is highly correlated with `gross_revenue` and 2 other fields	High correlation
`var_products` is highly correlated with `gross_revenue` and 2 other fields	High correlation
`qnt_items` is highly correlated with `gross_revenue` and 3 other fields	High correlation
`freq_purchase` is highly correlated with `qnt_purchases`	High correlation
`qtd_returned` is highly correlated with `freq_returns` and 2 other fields	High correlation
`freq_returns` is highly correlated with `qtd_returned` and 2 other fields	High correlation
`avg_basket_size` is highly correlated with `gross_revenue` and 1 other fields	High correlation
`avg_basket_variety` is highly correlated with `var_products`	High correlation
`item_rp_ratio` is highly correlated with `qtd_returned` and 2 other fields	High correlation
`net_margin` is highly correlated with `qtd_returned` and 2 other fields	High correlation
`df_index` is highly correlated with `customer_id` and 1 other fields	High correlation
`customer_id` is highly correlated with `df_index` and 1 other fields	High correlation
`gross_revenue` is highly correlated with `qnt_purchases` and 2 other fields	High correlation
`recency_days` is highly correlated with `df_index` and 1 other fields	High correlation
`qnt_purchases` is highly correlated with `gross_revenue` and 2 other fields	High correlation
`var_products` is highly correlated with `gross_revenue` and 2 other fields	High correlation
`qnt_items` is highly correlated with `gross_revenue` and 5 other fields	High correlation
`avg_ticket` is highly correlated with `qnt_items` and 2 other fields	High correlation
`qtd_returned` is highly correlated with `qnt_items` and 2 other fields	High correlation
`avg_basket_size` is highly correlated with `qnt_items` and 2 other fields	High correlation
`item_rp_ratio` is highly correlated with `net_margin`	High correlation
`net_margin` is highly correlated with `item_rp_ratio`	High correlation
`gross_revenue` is highly skewed (γ1 = 22.60448601)	Skewed
`qnt_items` is highly skewed (γ1 = 24.08929936)	Skewed
`avg_ticket` is highly skewed (γ1 = 71.36561628)	Skewed
`qtd_returned` is highly skewed (γ1 = 71.12000871)	Skewed
`avg_basket_size` is highly skewed (γ1 = 58.37737567)	Skewed
`item_rp_ratio` is highly skewed (γ1 = 75.47735114)	Skewed
`net_margin` is highly skewed (γ1 = -74.26063732)	Skewed
`df_index` is uniformly distributed	Uniform
`df_index` has unique values	Unique
`customer_id` has unique values	Unique
`qtd_returned` has 4200 (73.6%) zeros	Zeros
`freq_returns` has 4200 (73.6%) zeros	Zeros
`item_rp_ratio` has 4200 (73.6%) zeros	Zeros

Reproduction

Analysis started	2021-10-22 18:36:59.703429
Analysis finished	2021-10-22 18:37:21.785251
Duration	22.08 seconds
Software version	pandas-profiling v3.1.0
Download configuration	config.json

df_index
Real number (ℝ_≥0)

HIGH CORRELATION
UNIFORM
UNIQUE

Distinct	5705
Distinct (%)	100.0%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	2900.82752

Minimum	0
Maximum	5795
Zeros	1
Zeros (%)	< 0.1%
Negative	0
Negative (%)	0.0%
Memory size	44.7 KiB

Quantile statistics

Minimum	0
5-th percentile	290.2
Q1	1457
median	2903
Q3	4348
95-th percentile	5503.8
Maximum	5795
Range	5795
Interquartile range (IQR)	2891

Descriptive statistics

Standard deviation	1671.81192
Coefficient of variation (CV)	0.5763224145
Kurtosis	-1.196226531
Mean	2900.82752
Median Absolute Deviation (MAD)	1446
Skewness	-0.003583510807
Sum	16549221
Variance	2794955.097
Monotonicity	Strictly increasing

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0	1	< 0.1%
3852	1	< 0.1%
3872	1	< 0.1%
3871	1	< 0.1%
3870	1	< 0.1%
3869	1	< 0.1%
3868	1	< 0.1%
3867	1	< 0.1%
3866	1	< 0.1%
3865	1	< 0.1%
Other values (5695)	5695	99.8%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	1	< 0.1%
1	1	< 0.1%
2	1	< 0.1%
3	1	< 0.1%
4	1	< 0.1%
5	1	< 0.1%
6	1	< 0.1%
7	1	< 0.1%
8	1	< 0.1%
9	1	< 0.1%

Value	Count	Frequency (%)
5795	1	< 0.1%
5794	1	< 0.1%
5793	1	< 0.1%
5792	1	< 0.1%
5791	1	< 0.1%
5790	1	< 0.1%
5789	1	< 0.1%
5788	1	< 0.1%
5787	1	< 0.1%
5786	1	< 0.1%

customer_id
Real number (ℝ_≥0)

HIGH CORRELATION
UNIQUE

Distinct	5705
Distinct (%)	100.0%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	16602.92235

Minimum	12346
Maximum	22709
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	44.7 KiB

Quantile statistics

Minimum	12346
5-th percentile	12697.6
Q1	14288
median	16229
Q3	18213
95-th percentile	21746.2
Maximum	22709
Range	10363
Interquartile range (IQR)	3925

Descriptive statistics

Standard deviation	2811.170356
Coefficient of variation (CV)	0.1693178043
Kurtosis	-0.8232857661
Mean	16602.92235
Median Absolute Deviation (MAD)	1964
Skewness	0.4409745831
Sum	94719672
Variance	7902678.772
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
17850	1	< 0.1%
21071	1	< 0.1%
17123	1	< 0.1%
17891	1	< 0.1%
16498	1	< 0.1%
13745	1	< 0.1%
15584	1	< 0.1%
21089	1	< 0.1%
21088	1	< 0.1%
21087	1	< 0.1%
Other values (5695)	5695	99.8%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
12346	1	< 0.1%
12347	1	< 0.1%
12348	1	< 0.1%
12349	1	< 0.1%
12350	1	< 0.1%
12352	1	< 0.1%
12353	1	< 0.1%
12354	1	< 0.1%
12355	1	< 0.1%
12356	1	< 0.1%

Value	Count	Frequency (%)
22709	1	< 0.1%
22708	1	< 0.1%
22707	1	< 0.1%
22706	1	< 0.1%
22705	1	< 0.1%
22704	1	< 0.1%
22700	1	< 0.1%
22699	1	< 0.1%
22696	1	< 0.1%
22695	1	< 0.1%

gross_revenue
Real number (ℝ_≥0)

HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION
SKEWED

Distinct	5459
Distinct (%)	95.7%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	1772.229166

Minimum	0.42
Maximum	279138.02
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	44.7 KiB

Quantile statistics

Minimum	0.42
5-th percentile	13.32
Q1	236.3
median	612.78
Q3	1568.23
95-th percentile	5305.816
Maximum	279138.02
Range	279137.6
Interquartile range (IQR)	1331.93

Descriptive statistics

Standard deviation	7575.73186
Coefficient of variation (CV)	4.274690885
Kurtosis	676.7694665
Mean	1772.229166
Median Absolute Deviation (MAD)	478.32
Skewness	22.60448601
Sum	10110567.39
Variance	57391713.21
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
7.95	9	0.2%
2.95	8	0.1%
4.95	8	0.1%
1.25	8	0.1%
3.75	7	0.1%
1.65	7	0.1%
12.75	7	0.1%
4.25	6	0.1%
5.95	6	0.1%
7.5	6	0.1%
Other values (5449)	5633	98.7%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0.42	1	< 0.1%
0.65	1	< 0.1%
0.79	1	< 0.1%
0.84	4	0.1%
0.85	3	0.1%
1.07	1	< 0.1%
1.25	8	0.1%
1.44	1	< 0.1%
1.65	7	0.1%
1.69	1	< 0.1%

Value	Count	Frequency (%)
279138.02	1	< 0.1%
259657.3	1	< 0.1%
194550.79	1	< 0.1%
140450.72	1	< 0.1%
124564.53	1	< 0.1%
117379.63	1	< 0.1%
91062.38	1	< 0.1%
77183.6	1	< 0.1%
72882.09	1	< 0.1%
66653.56	1	< 0.1%

recency_days
Real number (ℝ_≥0)

HIGH CORRELATION
HIGH CORRELATION

Distinct	304
Distinct (%)	5.3%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	116.9258545

Minimum	0
Maximum	373
Zeros	37
Zeros (%)	0.6%
Negative	0
Negative (%)	0.0%
Memory size	44.7 KiB

Quantile statistics

Minimum	0
5-th percentile	3
Q1	23
median	71
Q3	200
95-th percentile	338
Maximum	373
Range	373
Interquartile range (IQR)	177

Descriptive statistics

Standard deviation	111.5740338
Coefficient of variation (CV)	0.9542289363
Kurtosis	-0.6403097319
Mean	116.9258545
Median Absolute Deviation (MAD)	61
Skewness	0.8143906836
Sum	667062
Variance	12448.76501
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
1	110	1.9%
4	105	1.8%
3	98	1.7%
2	92	1.6%
10	86	1.5%
8	82	1.4%
9	79	1.4%
17	79	1.4%
7	78	1.4%
15	67	1.2%
Other values (294)	4829	84.6%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	37	0.6%
1	110	1.9%
2	92	1.6%
3	98	1.7%
4	105	1.8%
5	52	0.9%
7	78	1.4%
8	82	1.4%
9	79	1.4%
10	86	1.5%

Value	Count	Frequency (%)
373	23	0.4%
372	23	0.4%
371	17	0.3%
369	4	0.1%
368	13	0.2%
367	16	0.3%
366	15	0.3%
365	19	0.3%
364	11	0.2%
362	7	0.1%

qnt_purchases
Real number (ℝ_≥0)

HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION

Distinct	56
Distinct (%)	1.0%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	3.468010517

Minimum	1
Maximum	206
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	44.7 KiB

Quantile statistics

Minimum	1
5-th percentile	1
Q1	1
median	1
Q3	4
95-th percentile	11
Maximum	206
Range	205
Interquartile range (IQR)	3

Descriptive statistics

Standard deviation	6.807826068
Coefficient of variation (CV)	1.963035012
Kurtosis	302.5604586
Mean	3.468010517
Median Absolute Deviation (MAD)	0
Skewness	13.20280307
Sum	19785
Variance	46.34649578
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
1	2876	50.4%
2	829	14.5%
3	504	8.8%
4	394	6.9%
5	237	4.2%
6	173	3.0%
7	138	2.4%
8	98	1.7%
9	69	1.2%
10	55	1.0%
Other values (46)	332	5.8%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
1	2876	50.4%
2	829	14.5%
3	504	8.8%
4	394	6.9%
5	237	4.2%
6	173	3.0%
7	138	2.4%
8	98	1.7%
9	69	1.2%
10	55	1.0%

Value	Count	Frequency (%)
206	1	< 0.1%
199	1	< 0.1%
124	1	< 0.1%
97	1	< 0.1%
91	2	< 0.1%
86	1	< 0.1%
72	1	< 0.1%
62	2	< 0.1%
60	1	< 0.1%
57	1	< 0.1%

var_products
Real number (ℝ_≥0)

HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION

Distinct	529
Distinct (%)	9.3%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	92.53531989

Minimum	1
Maximum	7838
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	44.7 KiB

Quantile statistics

Minimum	1
5-th percentile	2
Q1	14
median	41
Q3	106
95-th percentile	331.8
Maximum	7838
Range	7837
Interquartile range (IQR)	92

Descriptive statistics

Standard deviation	210.4062511
Coefficient of variation (CV)	2.273793957
Kurtosis	511.099444
Mean	92.53531989
Median Absolute Deviation (MAD)	33
Skewness	17.76686848
Sum	527914
Variance	44270.79052
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
1	256	4.5%
2	149	2.6%
3	108	1.9%
10	101	1.8%
6	99	1.7%
9	92	1.6%
5	91	1.6%
4	87	1.5%
11	84	1.5%
7	83	1.5%
Other values (519)	4555	79.8%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
1	256	4.5%
2	149	2.6%
3	108	1.9%
4	87	1.5%
5	91	1.6%
6	99	1.7%
7	83	1.5%
8	81	1.4%
9	92	1.6%
10	101	1.8%

Value	Count	Frequency (%)
7838	1	< 0.1%
5673	1	< 0.1%
5095	1	< 0.1%
4580	1	< 0.1%
2698	1	< 0.1%
2379	1	< 0.1%
2060	1	< 0.1%
1818	1	< 0.1%
1673	1	< 0.1%
1637	1	< 0.1%

qnt_items
Real number (ℝ_≥0)

HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION
SKEWED

Distinct	1840
Distinct (%)	32.3%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	963.3996494

Minimum	1
Maximum	196844
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	44.7 KiB

Quantile statistics

Minimum	1
5-th percentile	4
Q1	106
median	317
Q3	804
95-th percentile	2926.4
Maximum	196844
Range	196843
Interquartile range (IQR)	698

Descriptive statistics

Standard deviation	4296.512152
Coefficient of variation (CV)	4.459740207
Kurtosis	864.8815057
Mean	963.3996494
Median Absolute Deviation (MAD)	253
Skewness	24.08929936
Sum	5496195
Variance	18460016.68
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
1	114	2.0%
2	73	1.3%
3	51	0.9%
4	49	0.9%
5	35	0.6%
6	29	0.5%
12	25	0.4%
88	22	0.4%
72	21	0.4%
7	20	0.4%
Other values (1830)	5266	92.3%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
1	114	2.0%
2	73	1.3%
3	51	0.9%
4	49	0.9%
5	35	0.6%
6	29	0.5%
7	20	0.4%
8	18	0.3%
9	7	0.1%
10	17	0.3%

Value	Count	Frequency (%)
196844	1	< 0.1%
80263	1	< 0.1%
77373	1	< 0.1%
74215	1	< 0.1%
69993	1	< 0.1%
64549	1	< 0.1%
64124	1	< 0.1%
63312	1	< 0.1%
58343	1	< 0.1%
57885	1	< 0.1%

avg_ticket
Real number (ℝ_≥0)

HIGH CORRELATION
HIGH CORRELATION
SKEWED

Distinct	5511
Distinct (%)	96.6%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	44.69523826

Minimum	0.42
Maximum	77183.6
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	44.7 KiB

Quantile statistics

Minimum	0.42
5-th percentile	3.462222222
Q1	7.95
median	15.85882353
Q3	21.97516949
95-th percentile	76.24171429
Maximum	77183.6
Range	77183.18
Interquartile range (IQR)	14.02516949

Descriptive statistics

Standard deviation	1042.883788
Coefficient of variation (CV)	23.33321913
Kurtosis	5254.947144
Mean	44.69523826
Median Absolute Deviation (MAD)	7.494723111
Skewness	71.36561628
Sum	254986.3343
Variance	1087606.596
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
3.75	11	0.2%
4.95	10	0.2%
1.25	9	0.2%
2.95	9	0.2%
7.95	8	0.1%
1.65	7	0.1%
12.75	7	0.1%
8.25	7	0.1%
3.35	6	0.1%
4.15	6	0.1%
Other values (5501)	5625	98.6%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0.42	3	0.1%
0.535	1	< 0.1%
0.65	1	< 0.1%
0.79	1	< 0.1%
0.8371428571	1	< 0.1%
0.84	2	< 0.1%
0.85	3	0.1%
1.002222222	1	< 0.1%
1.02	1	< 0.1%
1.03875	1	< 0.1%

Value	Count	Frequency (%)
77183.6	1	< 0.1%
13305.5	1	< 0.1%
4453.43	1	< 0.1%
3861	1	< 0.1%
3202.92	1	< 0.1%
3096	1	< 0.1%
1687.2	1	< 0.1%
1377.077778	1	< 0.1%
1001.2	1	< 0.1%
952.9875	1	< 0.1%

freq_purchase
Real number (ℝ_≥0)

HIGH CORRELATION
HIGH CORRELATION

Distinct	1226
Distinct (%)	21.5%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	0.5475900988

Minimum	0.005449591281
Maximum	17
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	44.7 KiB

Quantile statistics

Minimum	0.005449591281
5-th percentile	0.01104972376
Q1	0.025
median	1
Q3	1
95-th percentile	1
Maximum	17
Range	16.99455041
Interquartile range (IQR)	0.975

Descriptive statistics

Standard deviation	0.5504405784
Coefficient of variation (CV)	1.005205499
Kurtosis	138.6978064
Mean	0.5475900988
Median Absolute Deviation (MAD)	0
Skewness	4.846833994
Sum	3124.001514
Variance	0.3029848303
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
1	2884	50.6%
2	48	0.8%
0.0625	18	0.3%
0.02777777778	17	0.3%
0.02380952381	16	0.3%
0.08333333333	15	0.3%
0.09090909091	15	0.3%
0.03448275862	15	0.3%
0.02941176471	14	0.2%
0.07692307692	13	0.2%
Other values (1216)	2650	46.5%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0.005449591281	1	< 0.1%
0.005464480874	1	< 0.1%
0.005479452055	1	< 0.1%
0.005494505495	1	< 0.1%
0.005586592179	2	< 0.1%
0.005602240896	1	< 0.1%
0.005617977528	2	< 0.1%
0.00566572238	1	< 0.1%
0.005681818182	2	< 0.1%
0.005698005698	3	0.1%

Value	Count	Frequency (%)
17	1	< 0.1%
4	1	< 0.1%
3	5	0.1%
2	48	0.8%
1.142857143	1	< 0.1%
1	2884	50.6%
0.75	1	< 0.1%
0.6666666667	3	0.1%
0.550802139	1	< 0.1%
0.5335120643	1	< 0.1%

qtd_returned
Real number (ℝ_≥0)

HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION
SKEWED
ZEROS

Distinct	214
Distinct (%)	3.8%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	31.2138475

Minimum	0
Maximum	74215
Zeros	4200
Zeros (%)	73.6%
Negative	0
Negative (%)	0.0%
Memory size	44.7 KiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	0
median	0
Q3	1
95-th percentile	38
Maximum	74215
Range	74215
Interquartile range (IQR)	1

Descriptive statistics

Standard deviation	1003.441796
Coefficient of variation (CV)	32.14732808
Kurtosis	5241.542158
Mean	31.2138475
Median Absolute Deviation (MAD)	0
Skewness	71.12000871
Sum	178075
Variance	1006895.439
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0	4200	73.6%
1	169	3.0%
2	151	2.6%
3	105	1.8%
4	89	1.6%
6	78	1.4%
5	61	1.1%
12	52	0.9%
7	44	0.8%
8	43	0.8%
Other values (204)	713	12.5%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	4200	73.6%
1	169	3.0%
2	151	2.6%
3	105	1.8%
4	89	1.6%
5	61	1.1%
6	78	1.4%
7	44	0.8%
8	43	0.8%
9	41	0.7%

Value	Count	Frequency (%)
74215	1	< 0.1%
9014	1	< 0.1%
8004	1	< 0.1%
4427	1	< 0.1%
3768	1	< 0.1%
3332	1	< 0.1%
2878	1	< 0.1%
2022	1	< 0.1%
2012	1	< 0.1%
1776	1	< 0.1%

freq_returns
Real number (ℝ_≥0)

HIGH CORRELATION
HIGH CORRELATION
ZEROS

Distinct	428
Distinct (%)	7.5%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	0.1621964162

Minimum	0
Maximum	4
Zeros	4200
Zeros (%)	73.6%
Negative	0
Negative (%)	0.0%
Memory size	44.7 KiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	0
median	0
Q3	0.01016949153
95-th percentile	1
Maximum	4
Range	4
Interquartile range (IQR)	0.01016949153

Descriptive statistics

Standard deviation	0.3734871455
Coefficient of variation (CV)	2.302684327
Kurtosis	4.821364232
Mean	0.1621964162
Median Absolute Deviation (MAD)	0
Skewness	2.194591618
Sum	925.3305543
Variance	0.1394926479
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0	4200	73.6%
1	857	15.0%
2	14	0.2%
0.5	8	0.1%
0.2857142857	8	0.1%
0.02564102564	7	0.1%
0.25	6	0.1%
0.009478672986	5	0.1%
0.2222222222	5	0.1%
0.01298701299	5	0.1%
Other values (418)	590	10.3%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	4200	73.6%
0.005571030641	1	< 0.1%
0.005681818182	2	< 0.1%
0.005865102639	1	< 0.1%
0.005934718101	1	< 0.1%
0.005952380952	1	< 0.1%
0.006024096386	1	< 0.1%
0.006042296073	1	< 0.1%
0.006172839506	1	< 0.1%
0.006191950464	1	< 0.1%

Value	Count	Frequency (%)
4	1	< 0.1%
3	1	< 0.1%
2	14	0.2%
1	857	15.0%
0.75	1	< 0.1%
0.6666666667	4	0.1%
0.5	8	0.1%
0.4285714286	1	< 0.1%
0.4	4	0.1%
0.3333333333	1	< 0.1%

avg_basket_size
Real number (ℝ_≥0)

HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION
SKEWED

Distinct	2370
Distinct (%)	41.5%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	261.1061465

Minimum	1
Maximum	74215
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	44.7 KiB

Quantile statistics

Minimum	1
5-th percentile	4
Q1	75
median	152
Q3	290.625
95-th percentile	733.1
Maximum	74215
Range	74214
Interquartile range (IQR)	215.625

Descriptive statistics

Standard deviation	1073.214896
Coefficient of variation (CV)	4.110262859
Kurtosis	3964.741092
Mean	261.1061465
Median Absolute Deviation (MAD)	96.5
Skewness	58.37737567
Sum	1489610.566
Variance	1151790.214
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
1	115	2.0%
2	72	1.3%
3	51	0.9%
4	49	0.9%
5	35	0.6%
6	29	0.5%
12	26	0.5%
100	22	0.4%
72	22	0.4%
73	21	0.4%
Other values (2360)	5263	92.3%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
1	115	2.0%
2	72	1.3%
3	51	0.9%
3.333333333	1	< 0.1%
4	49	0.9%
5	35	0.6%
5.333333333	1	< 0.1%
5.666666667	1	< 0.1%
6	29	0.5%
6.142857143	1	< 0.1%

Value	Count	Frequency (%)
74215	1	< 0.1%
14149	1	< 0.1%
13956	1	< 0.1%
7824	1	< 0.1%
6009.333333	1	< 0.1%
5963	1	< 0.1%
5197	1	< 0.1%
4300	1	< 0.1%
4282	1	< 0.1%
4280	1	< 0.1%

avg_basket_variety
Real number (ℝ_≥0)

HIGH CORRELATION
HIGH CORRELATION

Distinct	1171
Distinct (%)	20.5%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	37.24696204

Minimum	0.2
Maximum	1109
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	44.7 KiB

Quantile statistics

Minimum	0.2
5-th percentile	1
Q1	7.25
median	15.07142857
Q3	31
95-th percentile	173
Maximum	1109
Range	1108.8
Interquartile range (IQR)	23.75

Descriptive statistics

Standard deviation	76.82077129
Coefficient of variation (CV)	2.062470792
Kurtosis	32.94424993
Mean	37.24696204
Median Absolute Deviation (MAD)	9.928571429
Skewness	5.077303066
Sum	212493.9185
Variance	5901.430901
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
1	278	4.9%
2	161	2.8%
3	115	2.0%
10	105	1.8%
9	105	1.8%
8	103	1.8%
5	101	1.8%
7	101	1.8%
6	101	1.8%
13	97	1.7%
Other values (1161)	4438	77.8%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0.2	1	< 0.1%
0.25	3	0.1%
0.3333333333	7	0.1%
0.4	1	< 0.1%
0.4090909091	1	< 0.1%
0.5	12	0.2%
0.5454545455	1	< 0.1%
0.5555555556	1	< 0.1%
0.5714285714	1	< 0.1%
0.6176470588	1	< 0.1%

Value	Count	Frequency (%)
1109	1	< 0.1%
748	1	< 0.1%
730	1	< 0.1%
720	1	< 0.1%
703	1	< 0.1%
686	1	< 0.1%
675	1	< 0.1%
673	1	< 0.1%
660	1	< 0.1%
649	1	< 0.1%

item_rp_ratio
Real number (ℝ_≥0)

HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION
SKEWED
ZEROS

Distinct	1382
Distinct (%)	24.2%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	0.06254345309

Minimum	0
Maximum	282
Zeros	4200
Zeros (%)	73.6%
Negative	0
Negative (%)	0.0%
Memory size	44.7 KiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	0
median	0
Q3	0.001086956522
95-th percentile	0.04131473197
Maximum	282
Range	282
Interquartile range (IQR)	0.001086956522

Descriptive statistics

Standard deviation	3.734264988
Coefficient of variation (CV)	59.70672874
Kurtosis	5699.532667
Mean	0.06254345309
Median Absolute Deviation (MAD)	0
Skewness	75.47735114
Sum	356.8103999
Variance	13.944735
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0	4200	73.6%
1	12	0.2%
0.01075268817	4	0.1%
0.009661835749	4	0.1%
0.007462686567	3	0.1%
0.03846153846	3	0.1%
0.5	3	0.1%
0.0243902439	3	0.1%
0.02380952381	3	0.1%
0.01492537313	3	0.1%
Other values (1372)	1467	25.7%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	4200	73.6%
0.0001169636243	1	< 0.1%
0.0001839926403	1	< 0.1%
0.0002816901408	1	< 0.1%
0.0003140703518	1	< 0.1%
0.0003619254434	1	< 0.1%
0.0003632401017	1	< 0.1%
0.0003637686431	1	< 0.1%
0.0003671071953	1	< 0.1%
0.000393081761	1	< 0.1%

Value	Count	Frequency (%)
282	1	< 0.1%
3.275862069	1	< 0.1%
1.551912568	1	< 0.1%
1	12	0.2%
0.9863013699	1	< 0.1%
0.8333333333	1	< 0.1%
0.6333333333	1	< 0.1%
0.6115107914	1	< 0.1%
0.6008836524	1	< 0.1%
0.5964566929	1	< 0.1%

net_margin
Real number (ℝ)

HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION
SKEWED

Distinct	1498
Distinct (%)	26.3%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	0.9746389265

Minimum	-53.124
Maximum	1
Zeros	12
Zeros (%)	0.2%
Negative	3
Negative (%)	0.1%
Memory size	44.7 KiB

Quantile statistics

Minimum	-53.124
5-th percentile	0.9299445896
Q1	0.9978968552
median	1
Q3	1
95-th percentile	1
Maximum	1
Range	54.124
Interquartile range (IQR)	0.00210314482

Descriptive statistics

Standard deviation	0.720476139
Coefficient of variation (CV)	0.7392236442
Kurtosis	5575.872973
Mean	0.9746389265
Median Absolute Deviation (MAD)	0
Skewness	-74.26063732
Sum	5560.315076
Variance	0.5190858669
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
1	3722	65.2%
1	224	3.9%
1	161	2.8%
1	93	1.6%
0	12	0.2%
0.9809727315	1	< 0.1%
0.9981934633	1	< 0.1%
0.9947665325	1	< 0.1%
0.9631287859	1	< 0.1%
0.9796857062	1	< 0.1%
Other values (1488)	1488	26.1%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
-53.124	1	< 0.1%
-1.369603098	1	< 0.1%
-0.1218700375	1	< 0.1%
0	12	0.2%
0.04946653734	1	< 0.1%
0.1336898396	1	< 0.1%
0.1401705408	1	< 0.1%
0.2502340912	1	< 0.1%
0.2829510229	1	< 0.1%
0.324117991	1	< 0.1%

Value	Count	Frequency (%)
1	224	3.9%
1	3722	65.2%
1	161	2.8%
1	93	1.6%
0.9999180769	1	< 0.1%
0.9998431613	1	< 0.1%
0.9997243132	1	< 0.1%
0.9996916904	1	< 0.1%
0.9996728761	1	< 0.1%
0.9996149715	1	< 0.1%

Spearman's ρ

The Spearman's rank correlation coefficient (ρ) is a measure of monotonic correlation between two variables, and is therefore better in catching nonlinear monotonic correlations than Pearson's r. It's value lies between -1 and +1, -1 indicating total negative monotonic correlation, 0 indicating no monotonic correlation and 1 indicating total positive monotonic correlation.

To calculate ρ for two variables X and Y, one divides the covariance of the rank variables of X and Y by the product of their standard deviations.

Pearson's r

The Pearson's correlation coefficient (r) is a measure of linear correlation between two variables. It's value lies between -1 and +1, -1 indicating total negative linear correlation, 0 indicating no linear correlation and 1 indicating total positive linear correlation. Furthermore, r is invariant under separate changes in location and scale of the two variables, implying that for a linear function the angle to the x-axis does not affect r.

To calculate r for two variables X and Y, one divides the covariance of X and Y by the product of their standard deviations.

Kendall's τ

Similarly to Spearman's rank correlation coefficient, the Kendall rank correlation coefficient (τ) measures ordinal association between two variables. It's value lies between -1 and +1, -1 indicating total negative correlation, 0 indicating no correlation and 1 indicating total positive correlation.

To calculate τ for two variables X and Y, one determines the number of concordant and discordant pairs of observations. τ is given by the number of concordant pairs minus the discordant pairs divided by the total number of pairs.

Phik (φk)

Phik (φk) is a new and practical correlation coefficient that works consistently between categorical, ordinal and interval variables, captures non-linear dependency and reverts to the Pearson correlation coefficient in case of a bivariate normal input distribution. There is extensive documentation available here.

Count
Matrix

A simple visualization of nullity by column.

Nullity matrix is a data-dense display which lets you quickly visually pick out patterns in data completion.

First rows

	df_index	customer_id	gross_revenue	recency_days	qnt_purchases	var_products	qnt_items	avg_ticket	freq_purchase	qtd_returned	freq_returns	avg_basket_size	avg_basket_variety	item_rp_ratio	net_margin
0	0	17850	5391.21	372.0	34.0	297.0	1733.0	18.152222	17.000000	40.0	1.000000	50.970588	0.617647	0.023081	0.980973
1	1	13047	3232.59	56.0	9.0	171.0	1390.0	18.904035	0.028302	35.0	0.023973	154.444444	11.666667	0.025180	0.955611
2	2	12583	6705.38	2.0	15.0	232.0	5028.0	28.902500	0.040323	50.0	0.105263	335.200000	7.600000	0.009944	0.988660
3	3	13748	948.25	95.0	5.0	28.0	439.0	33.866071	0.017921	0.0	0.000000	87.800000	4.800000	0.000000	1.000000
4	4	15100	876.00	333.0	3.0	3.0	80.0	292.000000	0.073171	22.0	0.078947	26.666667	0.333333	0.275000	0.725000
5	5	15291	4623.30	25.0	14.0	102.0	2102.0	45.326471	0.040115	29.0	0.032468	150.142857	4.357143	0.013796	0.984472
6	6	14688	5630.87	7.0	21.0	327.0	3621.0	17.219786	0.057221	399.0	0.019608	172.428571	7.047619	0.110191	0.907032
7	7	17809	5411.91	16.0	12.0	61.0	2057.0	88.719836	0.033520	41.0	0.013072	171.416667	3.833333	0.019932	0.987609
8	8	15311	60767.90	0.0	91.0	2379.0	38194.0	25.543464	0.243316	474.0	0.072193	419.714286	6.230769	0.012410	0.977808
9	9	16098	2005.63	87.0	7.0	67.0	613.0	29.934776	0.024390	0.0	0.000000	87.571429	4.857143	0.000000	1.000000

Last rows

	df_index	customer_id	gross_revenue	recency_days	qnt_purchases	var_products	qnt_items	avg_ticket	freq_purchase	avg_basket_size	avg_basket_variety	net_margin
5695	5786	22700	4839.42	1.0	1.0	62.0	1074.0	78.055161	1.0	1074.0	55.0	1.0
5696	5787	13298	360.00	1.0	1.0	2.0	96.0	180.000000	1.0	96.0	2.0	1.0
5697	5788	14569	227.39	1.0	1.0	12.0	79.0	18.949167	1.0	79.0	10.0	1.0
5698	5789	22704	17.90	1.0	1.0	7.0	14.0	2.557143	1.0	14.0	7.0	1.0
5699	5790	22705	3.35	1.0	1.0	2.0	2.0	1.675000	1.0	2.0	2.0	1.0
5700	5791	22706	5699.00	1.0	1.0	634.0	1747.0	8.988959	1.0	1747.0	634.0	1.0
5701	5792	22707	6756.06	0.0	1.0	730.0	2010.0	9.254877	1.0	2010.0	730.0	1.0
5702	5793	22708	3217.20	0.0	1.0	59.0	654.0	54.528814	1.0	654.0	56.0	1.0
5703	5794	22709	3950.72	0.0	1.0	217.0	731.0	18.206083	1.0	731.0	217.0	1.0
5704	5795	12713	794.55	0.0	1.0	37.0	505.0	21.474324	1.0	505.0	37.0	1.0

Overview

Variables

Interactions

Correlations

Spearman's ρ

Pearson's r

Kendall's τ

Phik (φk)

Missing values

Sample

First rows

Last rows